A Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools and Challenges for the Community

In recent years, deep learning (DL), a re-branding of neural networks (NNs), has risen to the top in numerous areas, namely computer vision (CV), speech recognition, natural language processing, etc. Whereas remote sensing (RS) possesses a number of unique challenges, primarily related to sensors and applications, inevitably RS draws from many of the same theories as CV; e.g., statistics, fusion, and machine learning, to name a few. This means that the RS community should be aware of, if not at the leading edge of, of advancements like DL. Herein, we provide the most comprehensive survey of state-of-the-art RS DL research. We also review recent new developments in the DL field that can be used in DL for RS. Namely, we focus on theories, tools and challenges for the RS community. Specifically, we focus on unsolved challenges and opportunities as it relates to (i) inadequate data sets, (ii) human-understandable solutions for modelling physical phenomena, (iii) Big Data, (iv) non-traditional heterogeneous data sources, (v) DL architectures and learning algorithms for spectral, spatial and temporal data, (vi) transfer learning, (vii) an improved theoretical understanding of DL systems, (viii) high barriers to entry, and (ix) training and optimizing the DL.Comment: 64 pages, 411 references. To appear in Journal of Applied Remote Sensin

Remote sensing of intertidal morphological change in Morecambe Bay, U.K., between 1991 and 2007

Tidal Flats are important examples of extensive areas of natural environment that remain relatively unaffected by man. Monitoring of tidal flats is required for a variety of purposes. Remote sensing has become an established technique for the measurement of topography over tidal flats. A further requirement is to measure topographic changes in order to measure sediment budgets. To date there have been few attempts to make quantitative estimates of morphological change over tidal flat areas. This paper illustrates the use of remote sensing to measure quantitative and qualitative changes in the tidal flats of Morecambe Bay during the relatively long period 1991–2007. An understanding of the patterns of sediment transport within the Bay is of considerable interest for coastal management and defence purposes. Tidal asymmetry is considered to be the dominant cause of morphological change in the Bay, with the higher currents associated with the flood tide being the main agency moulding the channel system. Quantitative changes were measured by comparing a Digital Elevation Model (DEM) of the intertidal zone formed using the waterline technique applied to satellite Synthetic Aperture Radar (SAR) images from 1991–1994, to a second DEM constructed from airborne laser altimetry data acquired in 2005. Qualitative changes were studied using additional SAR images acquired since 2003. A significant movement of sediment from below Mean Sea Level (MSL) to above MSL was detected by comparing the two Digital Elevation Models, though the proportion of this change that could be ascribed to seasonal effects was not clear. Between 1991 and 2004 there was a migration of the Ulverston channel of the river Leven north-east by about 5 km, followed by the development of a straighter channel to the west, leaving the previous channel decoupled from the river. This is thought to be due to independent tidal and fluvial forcing mechanisms acting on the channel. The results demonstrate the effectiveness of remote sensing for measurement of long-term morphological change in tidal flat areas. An alternative use of waterlines as partial bathymetry for assimilation into a morphodynamic model of the coastal zone is also discussed

Object Detection in 20 Years: A Survey

Object detection, as of one the most fundamental and challenging problems in computer vision, has received great attention in recent years. Its development in the past two decades can be regarded as an epitome of computer vision history. If we think of today's object detection as a technical aesthetics under the power of deep learning, then turning back the clock 20 years we would witness the wisdom of cold weapon era. This paper extensively reviews 400+ papers of object detection in the light of its technical evolution, spanning over a quarter-century's time (from the 1990s to 2019). A number of topics have been covered in this paper, including the milestone detectors in history, detection datasets, metrics, fundamental building blocks of the detection system, speed up techniques, and the recent state of the art detection methods. This paper also reviews some important detection applications, such as pedestrian detection, face detection, text detection, etc, and makes an in-deep analysis of their challenges as well as technical improvements in recent years.Comment: This work has been submitted to the IEEE TPAMI for possible publicatio

The agricultural impact of the 2015–2016 floods in Ireland as mapped through Sentinel 1 satellite imagery

peer-reviewedIrish Journal of Agricultural and Food Research | Volume 58: Issue 1 The agricultural impact of the 2015–2016 floods in Ireland as mapped through Sentinel 1 satellite imagery R. O’Haraemail , S. Green and T. McCarthy DOI: https://doi.org/10.2478/ijafr-2019-0006 | Published online: 11 Oct 2019 PDF Abstract Article PDF References Recommendations Abstract The capability of Sentinel 1 C-band (5 cm wavelength) synthetic aperture radio detection and ranging (RADAR) (abbreviated as SAR) for flood mapping is demonstrated, and this approach is used to map the extent of the extensive floods that occurred throughout the Republic of Ireland in the winter of 2015–2016. Thirty-three Sentinel 1 images were used to map the area and duration of floods over a 6-mo period from November 2015 to April 2016. Flood maps for 11 separate dates charted the development and persistence of floods nationally. The maximum flood extent during this period was estimated to be ~24,356 ha. The depth of rainfall influenced the magnitude of flood in the preceding 5 d and over more extended periods to a lesser degree. Reduced photosynthetic activity on farms affected by flooding was observed in Landsat 8 vegetation index difference images compared to the previous spring. The accuracy of the flood map was assessed against reports of flooding from affected farms, as well as other satellite-derived maps from Copernicus Emergency Management Service and Sentinel 2. Monte Carlo simulated elevation data (20 m resolution, 2.5 m root mean square error [RMSE]) were used to estimate the flood’s depth and volume. Although the modelled flood height showed a strong correlation with the measured river heights, differences of several metres were observed. Future mapping strategies are discussed, which include high–temporal-resolution soil moisture data, as part of an integrated multisensor approach to flood response over a range of spatial scales

Assessment of multi-temporal, multi-sensor radar and ancillary spatial data for grasslands monitoring in Ireland using machine learning approaches

Accurate inventories of grasslands are important for studies of carbon dynamics, biodiversity conservation and agricultural management. For regions with persistent cloud cover the use of multi-temporal synthetic aperture radar (SAR) data provides an attractive solution for generating up-to-date inventories of grasslands. This is even more appealing considering the data that will be available from upcoming missions such as Sentinel-1 and ALOS-2. In this study, the performance of three machine learning algorithms; Random Forests (RF), Support Vector Machines (SVM) and the relatively underused Extremely Randomised Trees (ERT) is evaluated for discriminating between grassland types over two large heterogeneous areas of Ireland using multi-temporal, multi-sensor radar and ancillary spatial datasets. A detailed accuracy assessment shows the efficacy of the three algorithms to classify different types of grasslands. Overall accuracies ≥ 88.7% (with kappa coefficient of 0.87) were achieved for the single frequency classifications and maximum accuracies of 97.9% (kappa coefficient of 0.98) for the combined frequency classifications. For most datasets, the ERT classifier outperforms SVM and RF

Post-failure evolution analysis of a rainfall-triggered landslide by multi-temporal interferometry SAR approaches integrated with geotechnical analysis

Persistent Scatterers Interferometry (PSI) represents one of the most powerful techniques for Earth's surface deformation processes' monitoring, especially for long-term evolution phenomena. In this work, a dataset of 34 TerraSAR-X StripMap images (October 2013–October 2014) has been processed by two PSI techniques - Coherent Pixel Technique-Temporal Sublook Coherence (CPT-TSC) and Small Baseline Subset (SBAS) - in order to study the evolution of a slow-moving landslide which occurred on February 23, 2012 in the Papanice hamlet (Crotone municipality, southern Italy) and induced by a significant rainfall event (185 mm in three days). The mass movement caused structural damage (buildings' collapse), and destruction of utility lines (gas, water and electricity) and roads. The results showed analogous displacement rates (30–40 mm/yr along the Line of Sight – LOS-of the satellite) with respect to the pre-failure phase (2008–2010) analyzed in previous works. Both approaches allowed detect the landslide-affected area, however the higher density of targets identified by means of CPT-TSC enabled to analyze in detail the slope behavior in order to design possible mitigation interventions. For this aim, a slope stability analysis has been carried out, considering the comparison between groundwater oscillations and time-series of displacement. Hence, the crucial role of the interaction between rainfall and groundwater level has been inferred for the landslide triggering. In conclusion, we showed that the integration of geotechnical and remote sensing approaches can be seen as the best practice to support stakeholders to design remedial works.Peer ReviewedPostprint (author's final draft